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Abstract. We apply the super duality formalism recently developed by the authors 
to obtain new equivalences of various module categories of general linear Lie superal- 
gebras. We establish the correspondence of standard, tilting, and simple modules, as 
well as the identification of the u-homology groups, under these category equivalences. 
As an application, we obtain a complete solution of the irreducible character problem 
for some new parabolic BGG categories of gl(7Ti|7i)-modules, including the full BGG 
category of gl(m|2)-modules, in terms of type A Kazhdan-Lusztig polynomials. 



1. Introduction 

Super duality is a powerful new approach developed in the past few years in the 
study of representation theory of Lie superalgebras. It provides a surprising direct link 
between various parabolic BGG categories of modules of Lie superalgebras and Lie 
algebras, and allows us to solve the fundamental irreducible character problem for Lie 
superalgebras in terms of Kazhdan-Lusztig polynomials for semisimple (or more gen- 
erally Kac-Moody) Lie algebras. Super duality was first formulated as conjectures for 
general linear Lie superalgebras in [CWZ, CW], and then formulated and established in 
much generality in [CL2, CLW] recently. Our super duality solution of the irreducible 
character problem for Lie superalgebras ultimately depends on the solution [BB, BK] of 
Kazhdan-Lusztig conjecture for Lie algebras [KL, Deo]. We also refer to [BS] for a com- 
pletely different approach towards the very special version of super duality conjecture 
as formulated in [CWZ]. 

The goal of this paper is to formulate and establish a new form of super duality 
(which is an equivalence of categories) for the general linear Lie superalgebras. The 
super duality formalism typically takes advantage of a type A branch which many 
Dynkin diagrams possess. In this paper we will apply the super duality formalism 
simultaneously to the two ends of the (super type A) Dynkin diagrams. We in addition 
establish a correspondence of tilting modules under super duality, which was omitted in 
our previous paper [CLW], besides the correspondences of standard and simple modules 
under super duality. We also show that super duality is actually an equivalence of tensor 
categories, which was not addressed in our earlier work. 

The version of super duality in this paper allows us to settle the irreducible char- 
acter problem in some new parabolic BGG categories of g[(m|n)-modules not covered 
in [CW, CL2, CLW] in terms of parabolic Kazhdan-Lusztig polynomials of type A. 
Brundan [Brl] conjectured that the full BGG category of g[(m|n)-modules (of integer 
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weights) categorifies the Fock space V®™ (g) (v*)'^'"^ g^j^^j j^g estabhshed a maximal para- 
boHc version of this conjecture for the category of finite-dimensional gl(m|n)-modules, 
where V and V* denote the natural Uq{Ql^)-niodule and its dual module, respectively. 
Various parabolic versions of Brundan's conjecture have been formulated and settled 
since then via the super duality approach ([CW, CL2]). However, the irreducible char- 
acter problem in the full BGG category for general m and n remained unsettled in loc. 
cit., except when m or n is at most 1. Our paper confirms a variant of Brundan's con- 
jecture on the full BGG category of 0[(m|n)-modules (with respect to a nonstandard 
Borel subalgebra of block type l|m|l) for ?i = 2 or m = 2, and we will return to address 
the case for general m and n in another paper. 

Recall the infinite-dimensional Lie algebra (which is a central extension with a 
central element denoted by K) has played a fundamental role in many different contexts. 
If K acts as a scalar £ on a g [go-module M, then i is called the level of the module 
M. Let ^ be a positive integer. A very special case of super duality states that the 
(semisimple) category of integrable gto^-niodules of positive level i is equivalent to a 
suitable category of gl^^-modules of negative level —i (which is far from being obvious 
to be semisimple) ; A weak version of the super duality on the Grothendieck group level 
suffices to recover the character formulas established by completely different methods 
in [KR] and [CLl, Remark 5.2]. 

Following Vogan [Vo], a computation of the u-homology groups is basically a com- 
putation of the (parabolic) Kazhdan-Lusztig polynomials. Super duality identifies the 
corresponding u-homology groups with coefficients in modules belonging to different 
categories. This in particular allows us to recover easily the computation of u-homology 
groups with coefficients in modules appearing in Howe duality decompositions (which 
were computed by completely different techniques in [CK, CKW, HLT, LZ]). 

To keep the paper at a reasonable length, we have omitted several proofs leading 
towards super duality, when they are similar to the ones in [CL2, CLW]. We also refer 
directly to [Brl, CW] for the Fock space formulation of some parabolic versions of 
Brundan's conjecture. 

We shall use the following notations throughout this paper. The symbols Z, N, and 
Z_|_ stand for the sets of all, positive, and non-negative integers, respectively. For a 
superspace V = Vq ® Vi and a homogeneous element v £ V, we use the notation \v\ 
to denote the Z2-degree of v. Finally all vector spaces, algebras, tensor products, et 
cetera, are over the field of complex numbers C. 

2. Lie superalgebras associated to various Dynkin diagrams 

In this section, we introduce a general linear Lie superalgebra g of infinite rank and 
its subalgebras g, g, g* and g*. We also formulate the finite-rank counterparts of these 
Lie superalgebras. 

2.1. General linear Lie superalgebra. We fix k € Z+. We consider the following 
ordered set I: 

(2.1) •••<-^<-l<-^<0< l<2<---<fc <^<l<^<-- - , 
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For A; > 0, set K = {1, . . . , k}, and for A; = 0, set IfC = 0. We define the following subsets 
of I: 

I:=KUZ, I := KU -Z+ U +Z+), 

r :=IKU(-^ -Z+)UN, f :=ICU(^ + Z). 

Consider the infinite-dimensional superspace V with ordered basis {vi\i G I}. We 
declare \vr\ = 0, if r S Z U K., and \vr\ = 1, if r G ^ + Z. With respect to this 
basis, a linear map on V may be identified with a complex matrix {ars)j.g^j- The 
Lie superalgebra qI{V) is the Lie subalgebra of linear transformations on V consisting 
of (ttrs) with Urs = for all but finitely many a^s's. Denote by Ers € qK^) the 
elementary matrix with 1 at the rth row and sth column and zero elsewhere. Denote 
by B := bK^) ® the central extension of 0((V^) by a one-dimensional center CK 
determined by the 2-cocycle 

a{A,B) :=StT{[^,A]B), A,Be5l{V), 
where 5 = ^r<o ^rr and Str denotes the supertrace. Observe that the cocycle a is a 
coboundary. Indeed, there is embedding l : qI{V) — >■ g, defined by sending A G qI{V) 
to A + Str{:3A)K (cf. [CLW, Section 2.5]). It is clear that l{qI{V)) is an ideal of g and 
g is a direct sum of the ideals t(g[(y)) and CK. For A G 5l{V) we denote 

A := i{A) - StT{2A)K e g. 

Let f) and b denote the standard Cartan subalgebra (Bj.^jCErr(BCK and the standard 
Borel subalgebra ©j,<^ ^, ^^^Ers © CK, respectively. Define Aq S f)* by 

Ao(K) = l, Ao(^rr) = 0, Vr gI 
Let ej G f)* be determined by (ej, Ejj) = 6ij for i, j G I and (ej, K) = 0. We set 

ttr := er - e^_^ 1 , r G ^-Z, and qj := ej - ej:pY, 1 < j < A; - 1. 

The totally ordered set I gives rise to a positive system for g 

A+ = {ej - ej I i < j, i,j G I}, 
whose associated fundamental system is given by 

~ _ f { a,. I r G \ {0} } U {eo - ej, e^ - e 1 , aj, a^,--- a-^ }, if A; / 0; 
~ \{ar \ r e^Z}, [fk = 0. 

Let (^1k) denote the following Dynkin diagram with fundamental system: 

c^c^o c^o 



The following is a Dynkin diagram together with the fundamental system 11 for g, 
where denotes an odd isotropic simple root: 
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^(0): 



— ^ — o — ® — — — ^ — 



e 1 a 1 
5 7 



When A; = 0, the diagram above means that the middle three terms are replaced by 
the odd isotropic simple root eo — ei. The Dynkin diagrams in the rest of the paper 

2 

are interpreted in the similar way for k = 0. 
Define 

Jo if r G I; 

ifrGl\L 

Let T be an automorphism of Q of order 4 defined by 

(2.2) T{Ers) := -(-1)I-I(IH+H)^,,, r{K) = -K. 

2.2. The subalgebras of q. The subalgebra of g generated by K and E^s with r, s G 
I (respectively I, I^, I ) is denoted by g (respectively g, g* and g*). The Cartan 
subalgebras (respectively Borel subalgebras) of g, g, g^ and g* induced from g are 
denoted by f), f), fj^ and f) (respectively b, b, b^ and b ) respectively. We set 



/3r := 



Vr G 

2 



For n G Z+, let (^^n), (^^^, (^n) and denote the following Dynkin diagrams with 
fixed fundamental systems: 



-O — 



(5) 



C^O — 

/3i_„ /33_„ 



/3i /32 /33 




/3„-2 /3„ 



-a 

/33 



In the limit re i— ?• oo, the associated Dynkin diagrams of ©, (5), (5) and ® are 
denoted by (~^, (^'jT) and (^"^, respectively. 

For m,n G Z+ U {oo}, let g(rre, n) denote the subalgebra of g generated by E^s with 
— m < r, s < n + 1 and r,s G I. Note that g(m,re) is a finite-dimensional subalgebra 
for m.n ^ "L^. Set 



g(m,re) 
^(m, re) 



n g(m,re), 
n g(rre,n), 



g(m,re) : 
g*(m,re) 



3 n g(rre,n), 
g* ng(reT,,re) 



Then ()(m,re) = f) R g(rre, re) and b(rre,re) = b H g(m, re) are the Cartan and Borel 
subalgebras of g(rre,re), and we have four variants of Cartan and Borel subalgebras 
for the remaining four Lie superalgebras with self-explanatory notations. The Dynkin 



SUPER DUALITY AND APPLICATIONS 5 

diagrams with given fundamental systems of Q{m,n), Q{m,n), Q'^{m,n) and g°{m,n) 
with respect to the Borel subalgebras b(m, n), b(m, n), b*(m, n) and b (m, n), are given 
as follows: 

V{Q{m,n)): 
2?(0(m,n)): 
D(g<>(m,n)) 

a5(r("i,n)) 

For m = n = oo, these become the Dynkin diagrams and simple systems of g, g, g^ and 
0* with respect to the Borel subalgebras b, b, b* and b , respectively. The fundamental 
systems of g, g, g* and g^ are denoted by 11, 11, 11^ and 11 , respectively. These 
fundamental systems of g(m,n), g(m,n), g(m, n), g*(m,n) and g^(m,n) are denoted 
by n*(m, n), n(m,n), n(m,n), n*(m,n) and 11 (m,n), respectively. 

2.3. Levi subalgebras. We fix an arbitrary subset Yq of {aj \1 < j < k — 1}. The set 
Y (respectively Y, Y, y*, Y^) denotes the union of Yq with the subset of 11 (respectively, 
of n, n, n*, if) consisting of elements of the form e^ — e^, with r, s € IH^Z (respectively 
I n iZ, I n iZ, P n iZ, f n ^Z) satisfying r < s < or < r < s. Let T (respectively I, 
T, F) be the standard Levi subalgebra of g (respectively g, g, g*, g^) corresponding 
to the set Y (respectively Y, Y, Y'^, Y^). Let p = [ + b (respectively p = [+ b, p = 1+ b, 
p* = + b*, p* = [ + b ) be the corresponding parabolic subalgebra of g (respectively 
0! 0) 0*) 0^) with nilradical u (respectively u, u, u*, iT) and opposite nilradical u_ 
(respectively u_, u_, u^, u^). 

Denote the standard Borel subalgebras b PI I (respectively b fl T, b R P, b n of [ 
(respectively I, P, [ ) by b[ (respectively b[, bp b[). For /u € f)* (respectively f)*, fi*i 
f)**, ^*), let L{l,fi) (respectively L{\.,ix), L(l, L{t^,fi), L(T , fi)) denote the highest 
weight irreducible (-(respectively [-, [ -)module of highest weight /x with respect 

to the standard Borel. We extend L{1, fi) to a p-module by letting u act trivially. Define 
as usual the parabolic Verma module A(/i) and its unique irreducible quotient L{fi) 
over 0: 

A(/i) :=IndSL([,^), A{fi)^L{fi). 

Similarly, we introduce the other four variants of parabolic Verma and irreducible 
quotient modules with self-explanatory notations. 

We shall also need the finite-rank counterparts of the above algebras. Let ((m, n) = 
lr\g{m,n). Then l{m,n) is a Levi subalgebra of 0(m, n). For fi G t)(m,n)*, let 
L{[{m,n), n) denote the highest weight irreducible [(m, n)-module of highest weight fi. 
As above, we can define parabolic Verma 0(m, n)-module A(-^ ,j)(^) and its irreducible 



— O — [x) — O — 
— o — TO — — ^ 



e-r - <s 1 



© — <s> — ® — o — © 
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quotient L{m,n){l^)- ^ completely parallel fashion, we have the other four variants of 
Levi subalgebras, parabolic Verma modules, and so on, with self-explanatory notations. 

2.4. The dominant weights. Given a partition ^ = {fii, fi2, ■ ■ let n' denote its 
conjugate partition. We also denote by 9{fi) the modified Probenius coordinates of 

where 

Here and below (b) := max{5, 0} for all 6 € M. Let a. A?, • • • , A° € C, A~ and A+ be two 
partitions. Associated to the tuple A = (a. A?, . . . , A^; A~, A"*"), set 

A+(A) :=i2^^+E^'^ ^^(^) ^= E^°^i+E(^'')^-^.-i' 

i=i jeN i=i jeN 

:= - J^Aje^j+i + aAo, A"(A) := - J^(A~);e_^.+ i + oAq. 

The tuple (a, X^, . . . , A^; A~, A"*") is said to satisfy a dominant condition if 

k 

(2.3) A°ej, a^) G Z+, for ah a G Fq, 

where denotes the coroot of a. Associated to such a dominant tuple and a G C, we 
define the weights (which will be called dominant) 

_ k ^ 

A := J] A^ej - i + ^ ^^^^)r^r + aAo G ^ 

A:=A-(A) + A+(A) G r, A := A-(A) + A+(A) gF, 

A^ := A"(A) + A+(A) G \f\ T := A~(A) + A+(A) G T*- 

The number a will be called the level of these weights. 

We denote by (respectively P^, P^, Pa^, 'pV~) the set of all dominant weights of 
the form A (respectively A, A, A^, A ) with a fixed a G C. Obviously, we have bijective 

maps between P+, P+, P^ , and given by A <-> A o A o A* ^ A^ for A G Pa- 
Finally, we let P+ = \J^^^P+. 

3. Change of highest weights for different Borel subalgebras 

In this section, using odd reflections, we will determine how a highest weight for a 
highest weight module changes from a standard Borel to another distinguished non- 
standard Borel subalgebra. 

We shall briefly explain the effect of an odd reflection on the highest weight of a 
highest weight irreducible module (cf., e.g., [PS, Lemma 1], [KW, Lemma 1.4]). Fix a 
Borel subalgebra S of a Lie superalgebra S with corresponding positive system $+(23). 
Let a be an isotropic odd simple root and be its corresponding coroot. Applying 
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the odd reflection with respect to a changes the Borel subalgebra 23 into a new Borel 
subalgebra whose corresponding positive system is = {—a} U $+(!B) \ {a}. 

Lemma 3.1. Let A he the highest weight with respect to "B of an irreducible module. 
If (A,a^) 7^ 0, then the highest weight of this irreducible module with respect to is 
X — a. If (A, a^) = 0, then the highest weight remains to be A. 

Even though it is unclear how the structures of Verma modules are related via odd 
reflections, the relation of their characters is simply described as follows. 

Lemma 3.2. Let A(S,S,A) and A(S,23°,A) denote the Q-Verma modules of highest 
weight A with respect to the Borel subalgebras S and "B", respectively. Then we have 

chA{9, S, A) = chA{9, A - a). 
Proof Follows from the identity = {-a} U \ {a}. □ 

For n € N, we introduce the following total orderings of the subsets of I: 

3 1 13 3 1 

(3.1) <---n^-l-?i^---n^-n^--n^--n^ " ~2 ^ ~2 

-<l-n^---^-2-<-1^0^T^----<A;-^1^2^---^n 

13 1 3 

-<-^-^ <n+-^n+l^n+-^n + 2^-- - , 

, , 3 1 13 3 1 

(3.2) ...^---n^-l-n^---n^-n^--n^--n^---^--^-- 

— _ 1 3 1 

-<l-n^---^-2^-1^0^1^----<A;^-^-^---^?i-- 

1 3 
-<1^2^---^n^n + -^n + l^n+-^-- - , 

/ X 3 1 

(3.3) •••^ n ^ -1 - n ^ n^-n^l-n^---^-1^0 

^ ^ 2 2 

1 3 3 1 - r 1 o 

-< n ^ ■■■ ^ < <l^---^A;^1^2^---^n 

2 2 2 2 

13 1 3 

^-^-^•••^n + -^n + l^n+-^n + 2^-- - , 

/ , 3 1 

(3.4) ■ ■ ■ ^ -- — n ^ -1 - n ^ -- - n ^ -n ^ 1 - n ^ ■ ■ ■ ^ -1 ^ 

1 3 
-<l-<2^---^n^n + -^n + l^n+-^-- - . 

For any total ordering of I, there is a Borel subalgebra of g spanned by the Cartan 
subalgebra f) and elements of the form Ers such that r < s with respect to the ordering. 
Conversely, any Borel subalgebra of g containing the Cartan subalgebra f) determines 
a unique total ordering of I. Let b^{n) (respectively b^{n), b^'^{n), b^^{n)) be the Borel 
subalgebras with respect to the ordering (3.1) (respectively (3.2), (3.3), (3.4)) of I. 
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Two elements a and b in an ordered set are said to be adjacent if there is no element 
j in the set satisfying a<j<boTa>j>b. For an odd simple root of the form — 
with r, s G I in the root system of a Borel subalgebra 23 of g containing the Cartan 
subalgebra f), the numbers r and s are adjacent with respect to the corresponding 
ordering. The ordering corresponding to the new Borel subalgebra obtained by applying 
the odd reflection with respect to er — Cs is the same as the ordering corresponding to 
the Borel subalgebra S except reversing the ordering of r and s. 

Remark 3.3. Any ordering preserving the orderings of positive integers, positive half 
integers, non-positive integers and negative half integers, and satisfying i < a < j 
for i G — iZ_|_, a G K and j € ^N, can be obtained by a sequence of reversing the 
orderings of two adjacent indices r and s with r G Z and s G ^ + Z satisfying r,s > 
or else r,s < 0. Thus, the Borel subalgebra with respect to an ordering satisfying 
the conditions above can be obtained by applying a sequence of odd reflections to the 
standard Borel subalgebra b. Moreover, we can choose a sequence of odd reflections in 
such a way that it leaves the sets of roots of u and u_ invariant. 

Hence, the Borel subalgebras b^{n), b^(n), b^^{n) and b*^(n) can be obtained from b 
by applying sequences of odd reflections leaving the sets of roots of u and u_ invariant. 
Let us spell out precisely the sequence of odd reflections required to obtain the Borel 
subalgebra b'*(n) from b leaving the sets of roots of u and u_ invariant. This process 
can be easily modified for the remaining cases. Starting with the Dynkin diagram of 
0, we apply the following sequence ^n(n — 1) odd reflections. First we apply one odd 
reflection corresponding to ei — es , then we apply two odd reflections corresponding to 

2 

62 — £5 and ei — es . After that we apply three odd reflections corresponding to €3 — e? , 

22 2 

€2 — 67, and ei — €7 , et cetera, until finally we apply n — 1 odd reflections corresponding 

2 2 

to e„_i — e„_i , e„_2 — e„_i , . . . , ei — e„_i . The corresponding fundamental system of 

"2 "2 2 

the resulting new Borel subalgebra for g is listed as follows: 

•••-(g^(gHO-{x>Hg^ — (%D — O — 0^8k--- 

Now we apply the following sequence of ^n(n — 1) odd reflections to the Dynkin 
diagram above. First we apply one odd reflection corresponding to e_i — e_i/2) then 
we apply two odd reflections corresponding to e_2 — e-3/2 and e_2 — £-1/2- After 
that we apply three odd reflections corresponding to e_3 — e_5/2; £-3 — £-3/2 
e_3 — e_i/2i et cetera, until flnally we apply n — 1 odd reflections corresponding to 

ei-n - e3/2-n,ei-n - e5/2-n, • • • , ^i-n " £-1/2- We obtain the Dynkin diagram of b''(n): 




The following lemma is a variant of Lemma 3.1 in our setting. 
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Lemma 3.4. Let a be an odd simple root of the form e^ — e^, r,s € I satisfying r < s < 
or < r < s, in the root system of a Borel subalgebra "B of I containing the Cartan 
subalgebra f). Let denote the new Borel subalgebra obtained by applying the odd 
reflection with respect to a to the Borel subalgebra B. For G f)*, let v be a B-highest 
weight vector in L{l,fi). 

(1) If ^{Err) + fi{Ess) = 0, then L{[,^) is an [-module of B"^ -highest weight A and 
V is a B^ -highest weight vector. 

(2) If fi{Err) + ^(-Ess) 7^ 0, then L{[, fi) is an [-module of B°' -highest weight A — a 
and EsrV is a B'^ -highest weight vector. 

Using similar arguments as in the proofs of [CL2, Lemma 3.2] and [CL2, Corollary 
3.3] (cf. [CLW, Proposition 4.3]) together with Lemma 3.4, we have the following. 

Proposition 3.5. Let A = (a, Ai, . . . , Aa,-; A^, A"*") G and n G N. 

(i) Suppose that < n and < n. Then the highest weight of L{[,X) with 
respect to the Borel subalgebra b'^(n) PI I zs A. Furthermore, A(A) and L{\) are 
highest weight Q-modules of highest weight A with respect to the Borel b^{n). 

(ii) Suppose that (A~)'^ < n and A^ < n. Then the highest weight of L([, X) with 
respect to the Borel subalgebra b'^{n) n[ is X. Furthermore, A (A) and L{X) are 
highest weight Q-modules of highest weight X with respect to the Borel b*(n). 

(iii) Suppose that Aj~ < n and (A+)'^ < n. Then the highest weight of L{[,X) with 
respect to the Borel subalgebra b^'^{n)n[ is X^. Furthermore, A(A) and L{X) are 
highest weight Q-modules of highest weight X^ with respect to the Borel b^'^(n). 

(iv) Suppose that A]~ < n and Xf < n. Then the highest weight of L{[, X) with 
respect to the Borel subalgebra b^^ {n)ri[ is A*. Furthermore, A(A) and L(X) are 
highest weight Q-modules of highest weight with respect to the Borel b^'^(n). 

4. Super duality 

In this section, we first introduce the module categories Oa, Oa, Oa, Oa ™d 0^ for 
the infinite-rank Lie super algebras g, g, g, g^, and g*, respectively. We also introduce 
functors T : Oa Oa, T : Oa ^ Oa, T" -.Oa^ 0* and : 0^ ^ 0^, and then show 
that they are equivalences of tensor categories which send parabolic Verma and simple 
modules to parabolic Verma and simple modules, respectively. 

4.1. BGG categories. Let be the category of g-modules M such that M is a 
semisimple f)-module with finite-dimensional weight subspaces My, 7 G f)*, satisfying 

(i) M decomposes over I into a direct sum of L([,J1) for fi G P^. 

(ii) There exist finitely many weights Ai, A2, . . . , Afc G (depending on M) such 
that if 7 is a weight in M, then 7 G Aj — X^^gfj Z+a, for some i. 
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The morphisms in are (not necessarily even) g-homomorphisms. We recall that 
€ HomQ(M, N) means that if{xv) = x(p{v), for x € g and v € M^. Let Oq be the full 
subcategory of consisting of the objects M € such that Kv = av for all v € M. We 
have = 0aeC '^^^ parabolic Verma modules A(/I) and irreducible modules L(/u) 
for /X G lie in 0^, by Lemma 4.1 below. Analogously we can define the other four 
variants 0, 0, 0^ and of the above categories for g, g, g*, and g* in self-expained 
notations, which contain the corresponding parabolic Verma and irreducible modules. 

Let r := {/i e ^* I fi{Err) = 0, |r| > 0}. For V = 0p Vy G Oa, there is a natural 
Z2-gradation = Vg Vj given by 

(4.1) := © V, and := V^, 

where := {/i G F | Xlr-ei/2+z /^(-^»'»') = ^ (mod 2)} (cf. [CL2, Section 2.5]). Let 11 
denote the parity change functor on 0. We define 0^ to be the full subcategories of 
Oa consisting of objects with Z2-gradation given by (4.1) and define 0^ to be the full 
subcategories of Oa consisting of objects IIM with M £ 0^. Note that the morphisms 
in 0^ and 0^ are of degree 0. It is clear that 0^ and 0^ are an abelian categories. 
For M = Mq + Mi £0, let Mq^^ = m), n Mg and Mj^^ = n Mj. Also we let 

K := © Mo,M' M{ := Mj,^; < := Mg,^, Mf := Mj,^. 

^J,&^l ^Grg 

It is clear that M' := M^^M{ and M" := M^' are submodules of M. Since 1} 
separates the M^'s, we have = Mg_^0Mj^^ for all ^. Therefore M = M'^M". 
Hence for every M G 0, M is even isomorphic to A^' IIA^" for some N', N" G 0*^. For 
A^ G 0, let : A^ — t- IIA^ be the parity-reversing isomorphism. Therefore for every 
M G 0, M is isomorphic to A^ for some A^ G 0*^. This implies that the kernel and the 
cokernel of ip belong to for M, N £ 0, and if G Homg(Af , A^). Hence is an abelian 
category. Also and 0*^ have isomorphic skeletons and hence they are equivalent 
categories. Note that for M,iV G 0°, 99 G Homg(nM,iV) and ip' G HomQ(M,niV), we 
have ip = (j) o Pjj^ and (p' = o (p' for some (p, cp' G Homg(M, A^). 

Analogously, 0^, 0*'' and 0^" denote the respective full subcategories of Oa, 0* and 
Oq consisting of objects with Z2-gradations given by (4.1) such that r are summed over 
half integers contained in the respective index sets; they are abelian and are equivalent 
to Oa, 0^ and 0^, respectively. 

Using similar arguments as in the proof of [CLW, Lemma 3.1], we have the following 
lemma. 



We remark that a different definition of homomorphism is (fi{xv) — { — ly''''''^'x(p{v). The difference 
is inessential, as the map / — > /* given by f*{v) :— ( — provides a bijection between these two 
types of maps. 
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Lemma 4.1. Let fj, € . The restrictions to [ of the Q-modules A{fj,) and L{^) 
decompose into direct sums of L{i,ly) for v G . In particular, A{J1),L{J1) € Oa- 
Analogous results hold for the other four variants of categories for q, q, g*, and g*. 

4.2. The functors T^T, and T^. Wejhall introduce four functors T : 0^ ^ 0^, 
T : Oa ^ Oa, T^J Oa ^ 0^ and : Oa ^ ol- We will describe in detail the 
construction of T : 0^ — > 0^, and the remaining three variants can be treated similarly. 

By definition, q is naturally a subalgebra of g, I is a subalgebra of I, and is a 
subalgebra of f). Furthermore, we may view fj* as a subspace of f)* by regarding f) as 
a direct summand of t) with respect to the natural basis E^rS. Given a semisimple 
t)-module M = ©^g^;, M^, we define 

T{M) := M^. 

Note that T{M) is an f)-submodule of M. It in addition M = 0^g|;* is an [-module, 
then T[M) is an [-submodule of M . Furthermore, if M = is a g-module, 

then T{M) is a g-submodule of M. 

The direct sum decomposition in M gives rise to the natural projection 

T-^j-.M — > T{M) 

which is an f)-module homomorphism. If in addition M is an [-module, then Tj^ is also 
an [-module homomorphism. Furthermore, if M is a g-module, then Tj^ is a g-module 
homomorphism. If / : i\/ is an [^-homomorphism, then the following induced map 

T[J\ : t(m) — > T{N) 

is an [)-module homomorphism. If in addition f : AI N is a [-homomorphism, then 
T[f] is an [-module homomorphism. Furthermore, \i f : M N \s a g-homomorphism, 
then T[f] is a g-module homomorphism. 

Lemma 4.2. For A € P^ , we have 

r(L(T,A)) = L([,A), T(L(T, A)) = L([, A), 

ro(L(T,A)) =L([-,A*), r(L(T,A)) =L(f,r). 

Proof. We will prove T(L([, A)) = A), and the other cases can be proved by the 
same argument. By Proposition 3.5, L([, A) contains a (b*(n) n [)-highest weight vector 
vj of highest weight A for n ^ 0. The vector vj clearly lies in T(L([, A)), and it is a 
(b nl)-singular vector since In b = In b'^i^n). Let w be any weight vector in T(L([, A)). 
Taking n large enough, we can assume that w £ U (g(n, n) D l)vj. Note that the Dynkin 

diagram of g(n,n) with respect to the Borel subalgebra 23 = g(n,n) n b^(n) is the 
following: 
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Let ?\f_ be the opposite nilradical of S n [. Then w € UCN-)!]^, and hence we see that 
w G U{l)i>^. This shows that r(L([, A)) is a highest weight [-module with respect to 
the Borel subalgebra f fl b of highest weight A. 

In order to complete the proof we need to show that T(L([, A)) is irreducible. Let 
w he a b PI T-singular vector in T(L([, A)). Choose q ^ with q > n such that 
w S U{g{q,q) nVjvj^. Since the root vector corresponding to a simple root in b^{q) 
either commutes with U{Q{q,q) H I) or annihilates w, w is a b*((7)-singular vector and 
hence w is a multiple of vj. Therefore T(L([, A)) is irreducible. □ 

Lemma 4.3. For /i,A G , we have 

(i) T(L(T,p^)®L(T,A)) =L(U)C5L(l,A), 

(ii) T{L{i,Jl) O L{1,Jk)) = L(I, /I) L{1 A), 

(iii) T''{L{{,Ji) LO, A)) = L(P,/i^) L(P, A^), 

(iv) T*(L([,/I)0L([,A)) =L(f,7r)0L(f,r). 

Proof. We will prove T(L([, /x) (g) L([, A)) = L([, ^) (g) A), and the other cases can be 
proved by using the same argument. By Lemma 4.2, we have 

T(L(T,/i)®L(T,A)) D «)L([,A). 

The lemma now follows by a comparison of the characters on both sides of (i). □ 

Proposition 4.4. The functors T : ^ 0, T : ^ 0, : ^ 0^ and : ^ 0^ 

are exact. 

Proof. In hght of Lemma 4.2, it suffices to show that if M G 0, then t(m), T{M), 
T'^iM), and T*(M) he in 0, 0, O'', and 0^, respectively. We shall only show that 
T{M) G 0, as the argument for the other cases is similar. Also below we will only 
prove the case A: > 1, as the case /c = is proved by slightly modifying the argument. 

It will be convenient to define n(t), n(£) and 11(3?) to be the sets {aj, . . . ,q^py}' 
CK-ii • • and {01/2, oi, • • respectively, for the remainder of the proof. 

Let M G 0. Then there exists iC,,2Ci ■ ■ ■ ir C-, with iC,,...,rC ^ such that any 
weight of M is bounded above by some iQ. Ignoring the level recall that we have 
jC, = {jC^,j C~ij C^)i where = {jCi, Ca!)) and jC,~^ and jC,~ are partitions with 
\jC~^\ = kj and |jC~l = ^j- For each j<^, let Pj be the following finite subset of t)*: 

Pj := {{jC^,r],fi) I ;U,r/ G y with |^| = kj and = Ij}. 

Set M := t(m) and P{M) := \J-^^ Pj. 

We claim that given any weight v of M, there exists 7 G P{M) such that 7— G Z+II. 
It suffices to prove the claim for v G P^. Since v is also a weight of M, we have 
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iC, — V ^ Z+n, for some i. Thus 

iQ-u = q{eo - ej) + p{e^ - ei/2) + + k+ + 

where p,q e EaGn{{) e E/3Gn(Z) ^+/^' ^""^ '^'^ ^ S/3Gn{S) ^+/^- '^^^'^ 

imphes that is a partition of size h + q and i/^ is a partition of ki + p, and hence 
there exists 7 G P[M) such that and are obtained from the partitions 7^ and 7" 
by adding p and q boxes, respectively. For every such a box of i/^, we record the row 
number in which it was added to 7^ in the multisets with \J~^\ = p and \J~\ = q. 
Then we have 

1/ = 7 - Ok - ^{e^-^j)- (e-j+i - ei)' 
ieJ+ jeJ- 

and hence ;/ < 7. Thus, we conclude that M G 0. □ 

4.3. A character formula. The following theorem can be regarded as a weak version 
of super duality which is to be established in Theorem 4.11. Using similar arguments 
as in the proof of [CLW, Theorem 4.5], we have the following. 

Theorem 4.5. Let M £0a and A € P+. If M is a highest weight 'g-module of highest 
weight X, then T{M), T[M), T'^{M) andT^{M) are highest weight modules over g, q, 
and g° of highest weights X, X, A* and X , respectively. Furthermore, we have 

(i) r(A(A)) = A(A) and T{l(X)) = L{X); 

(ii) r(A(A)) = A(A) andT{L(x)) =L(X); 

(iii) T^(A(A)) = A*(A*) and r*(Z(A)) = L^(A^); 

(iv) r^(A(A)) = A''(r) andT^lliX)) =V(X). 

By standard arguments. Theorem 4.5 implies the following character formula. 
Theorem 4.6. Let X € , and write chL(A) = E^ep+ afj,xchA{fi), G Z. Then 

(i) chZ(A) = E^ep+ a^AchAC^^), 

(ii) chL(A) = E;,6P+ o^AchA(7l). 

(iii) chL-(Ao) = E^gp+ a^AchA-(^-), 

(iv) chr (r) = E,.gp+ a^AchA'(7lo). 

4.4. Identification of Kazhdan-Lusztig polynomials. For a module V over a Lie 
(super)algebra 9 and j G Z_|_, let Hj{Q]V) denote the jth homology group of 9 with 
coefficient in V. For a precise definition of homology groups of Lie super algebras with 
coefficients in a module and a precise formula for the boundary operator we refer the 
reader to [Ta] or [CL2, Section 4]. 

For M e we denote by M = T(M) and M = T(M), = r^(M) and Jt = 

T (M). Using similar arguments as in the proof of [CLW, Theorem 4.10], we have the 
following. 

Theorem 4.7. We have, for j > 0, 

(i) T{Hj{u-;M)) ^ Hj{u-;M), as l-modules. 
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(ii) T{Hj{u_;M)) ^ Hj{u_;M), asl-modules. 

(iii) r*(i7j(u„;M)) ^ ffj(u^;M*), as ['"-modules. 

(iv) T'{Hj(u-;M)) ^ Hj{ut;lt), asT -modules. 

Setting M = L{X) in Theorem 4.7 and using Theorem 4.5 we obtain the following. 
Corollary 4.8. For X G P+ and j > 0, we have 

(i) r(ifj(u_;L(A))) ^ ifj(u_;L(A)), as {-modules. 

(ii) T(i7j(u_;L(A))) ^ Fj(u_;L(A)), asl-modules. 

(iii) r^(/fj(u_;Z(A))) ^ ifj(ui;L*(A^)), as {"-modules. 

(iv) r^(//j(u_;Z(A))) ^ Fj(ir;I^(r)), as T -modules. 

We define the parabolic Kazhdan-Lusztig polynomials for the categories Oa, Oaj Oaj 
0^ and 0„ associated to /x, A G Pj*" by letting 

oo 

^/:a(9) •= E (Homj [L(T, pf), (5-; L(A))] ) {-q)-^ , 

n=0 
oo 

^/.a('?) := E (Homi [L(l, ^), if,- (u_; L(A))] ) (-5)^^ 
i=o 

00 

^7ia(9) := Ed™c(Homj[L(l,7l),F,(u_;I(A))])(-,?)-^ 
i=o 

00 

^M^Ao(^) := Edimc(Homio[L(r,^-),i7,(u^„;LO(A<>))])(-9)-^ 

j=0 

00 

:=Edimc(Hom^»[L(f,r),i^ir-;r(r))])(-g)-^-. 
i=o 

By Vogan's homological interpretation of the Kazhdan-Lusztig polynomials [Vo, Con- 
jecture 3.4] and the Kazhdan-Lusztig conjecture [KL] (proved in [BB, BK]), l^x{q) coin- 
cides with the original definition in the setting of semisimple Lie algebras and moreover 
= o.^x (cf. Theorem 4.6). The following reformulation of Corollary 4.8 is a 
generalization of Theorem 4.6. 

Theorem 4.9. For A,^ € , we have the following identification of Kazhdan-Lusztig 
polynomials for the categories Oa, ^a, Oa? Oa and'O^: 

4.5. Super duality. 
Lemma 4.10. Let 

— > M' — > M — >M" — > 
be an exact sequence of q (respectively q, q, and ) -modules which are semisimple 
over t) (respectively f), f), and'^ ) such that M' , M" G 0^ (respectively Oa, Oa; Oq 
and 0^). Then M also belongs to Oa (respectively Oa, Oa, 0^ and 0^). 
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Proof. The statement for 0^ is clear. The statements for the other cases follow by 
arguments, for example, as for [CK, Theorems 3.1 and 3.2]. □ 

The arguments in [CLW, Section 5] can be adapted to prove the following theorem. 

Theorem 4^11 (Super Duality). The functors T : Oa ^ Oa, T : Oa ^ Oa, : Oa ^ 

0^ and : Oa — > Oa are equivalences of categories. 

Remark 4.12. In an extreme yet interesting case, the Lie superalgebra D(q) in Sec- 
tion 2.1 (when A; = 0) is associated to the following Dynkin diagram with all simple 
roots being odd; its subalgebra D{q) and D{q^) in Section 2.2 are Lie algebras associ- 
ated to the following Dynkin diagrams and fundamental systems: 

Dig): — — ^ — ^ — (Si — <S> — 0— ••• 

'^-3 a-i f^-i an ai ^3 

2 2 2 2 

Did): 



In the case when £ S N, we let 9" be the (semisimple) subcategory of Oi of integrable 
0[(,o-modules of level £. The corresponding subcategory of 0^ is a suitable subcategory 
XL of gtoQ-modules of negative level —i. By Theorem 4.11, U is equivalent to 3", and 
hence it is semisimple; moreover, we recover the character formulas for modules in U 
in [KR] and [CLl] that were obtained by completely different methods. 



4.6. Equivalence of tensor categories. Recall that any modules in 0^, o||, 0^' 
and 0^" are equipped natural Z2-gradations given by (4.1). Note that the functors T, 
T, T* and preserve the Z2-gradations of the modules. For M, € 0^, we have 
M(g)iV G 0° by [CK, Theorem 3.2] and hence 0° is a commutative tensor category (see, 
for example, [KS, Section 4.2]) with the trivial module as the unit object. Similarly, 

0, 0°, 0'^ and O^'' are commutative tensor categories with the unit objects (cf. [CK, 
Theorem 3.1, 3.2]). 

By Lemma 4.3 and Theorem 4.11, we have the following theorem. 

Theorem 4.13. The functors T : 0° ^ 0, T : 0° ^ 0°, : 0° ^ 0^°, and 
T : 0° ^ are equivalences of tensor categories. 

5. Tilting modules 
For M G 0° such that M = Y^^^j^M^, we consider the restricted dual 

MV — {y £ Homc(M,C) I /(M^) = 0, for all but finitely many 7 G f^*}, 

which is equipped with the usual Z2-gradation and g-action. We twist the usual g- 
module structure on with the automorphism r defined in (2.2), and denote the 
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resulting g-module by M"^. The Z2-gradation on M"^ equals the Z2-gradation defined 
by (4.1). There are natural isomorphisms (Ad'^Y = M. It is easy to see that ch(Af'^) = 
ch(M) and L{\Y = L{\). The restriction of r to [ is also denoted by r. Similarly, we 
can define L(T,/I)^ for ^ . Note that G 0° for ah M G 0° since L(T,/2)^ ^ 
L{l,Jl) for all fj. G P^. The contravariant functor from 0^ to itself defined by sending 
M to M"^ is also denoted by r. Note that the functor r is an isomorphism of categories. 
The restrictions of the automorphism r of g to g, g, and g* are also denoted by r. 

Similarly, we can define AT for an object M in 0^, 0°, Of and of. We show that 
belongs to the same category as M and (M'^Y = M. Also we have ch(M'^) = ch(M) 
and L'^ = L for all irreducible highest weight modules L. 
We summarize the above discussion in the following. 

Proposition 5.1. We have 1 o t = t o for 1 = T,T,T'' orT"". 

An object M G Oa is said to have a Verma flag if it has a (possibly infinite) increasing 
filtration of g-modules: 

= Mo C Ml QA'hQ--- 
such that M = Uj>oMj and each Mi/Mi-i is either or isomorphic to a parabolic 
Verma module A (A*) for some A* G P"*". We define (M : A(//)) for ji G P"*" to be the 
number of subquotients of a Verma fiag of M that are isomorphic to A(//). The notion 

of Verma fiag is defined in a similar fashion in the categories 0°, , and W . A 
tilting module associated to A G P~^ in the category is an indecomposable g-module 
U{X) such that 

(1) U{\) has a Verma fiag with A(A) at the bottom, and 

(2) Ext^(A(//), ;7(A)) = for ah fi G P+. 

For n G P+, the tilting module U(jl) (respectively U{]l), U^'i^f), if {JJ^)) in 0° (re- 
spectively , 0*°, ) are defined in a similar fashion. 

From the proposition below, the tilting module U{Ji) (respectively C/(A), U{]l), 
C/*(;U*), Tfi-jJ")) belongs to 0° (respectively 0^, 0°, Of, 0^°) for fi G P+. 

Proposition 5.2. For A G P^ , there exists a unique (up to isomorphism) tilting 
module U{X) associated to A in Oa- There also exists a unique (up to isomorphism) 
tilting module U{X) (respectively U{\), [/^(A*), Tf(f)) associated to A (respectively 
X, A^, T) in 0° (respectively 0°, Of, 0^°;. Moreover, we have T{u(X)) = U{X), 

T{U(X)) = U(X), r^(f/(A)) = [/(A*) andT{u(X)) = U{T) for X G P+, and = U 
for any tilting module U in either of these categories. 

Proof. The same proof for [CW, Theorem 3.14] ensures the existence of the tilting 
modules. From the construction of the tilting modules, we have U{XY = UiX) for 
A G P+. 

The uniqueness of the tilting modules follows by adapting an argument of Soergel 
[So, Section 5] (also cf. [Br2]). As the category Oa may not have enough injective 
objects, we need to modify the proof therein as follows. First we remark that every 
element in End(C/(A)) for A G Pa is either locally nilpotent or an isomorphism, since 
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U{X) is indecomposable and all its weight space is finite dimensional and the usual 
argument via the Fitting decomposition works. 

Let C be an abelian category of g-modules containing 0^ with enough injective 
objects such that every module in C is a semisimple f)-module. Let U{X) and U'{X) be 
two tilting modules associated to A in Oq. Then Exto(A(^), U'{X)) = for all fi € P^- 
By Lemma 4.10, Ext^(A(^), U'{X)) = for aU ^ G P+. Since U{X)/A{X) has a Verma 
flag, we can apply [So, Lemma 5.10] and conclude that Extg([/(A)/A(A), C/'(A)) = 0. 
Therefore we have 

^ Hom(C/(A)/A(A),[/'(A)) ^ Hom([/(A), C/'(A)) ^ Hom(A(A), [/'(A)) ^0. 

Hence there is (/? G Hom([/(A), C/'(A)) which restricts to the identity map on A(A). 
Similarly, there is if' G Hom(f7'(A), U{X)) which restricts to the identity map on A(A). 
Therefore ^poip' and 93' are isomorphisms since they are not locally nilpotent. Hence 
[/(A) and U'{X) are isomorphic. 

By Theorem 4.13, Theorem 4.5 and the first part of the proposition, tilting modules 

exist and are unique in the categories 0^, o||, 0^*^ and 0^". The last part of the theorem 
also follows from Proposition 5.1, Theorem 4.5 and U{XY = U{X) for A G P^. □ 

Remark 5.3. The argument above can be applied to show that there exists a unique 
tilting module associated to each dominant weight in the categories 0,0, and defined 
in [CLW, Section 3.2] as well. 

6. Character formula for general linear Lie superalgebras 

In this section we use the super duality and truncation functors to obtain character 
formulas for irreducible modules of general linear Lie superalgebras of finite rank. 

6.1. Module categories of finite-rank Lie superalgebras. We recall that the 
finite-rank Lie superalgebras Q{m,n), Q{m,n), 0(m, n), 0*(m,n), and Q^{m,n) are de- 
fined in Section 2.2 for m,n Z+. In this subsection, we introduce certain module 
categories of these finite-rank Lie superalgebras, and relate them to the categories 
studied earlier via the truncation functors (see Proposition 6.2). 

Let 0(m, n) be the full subcategory of Q{m, n)-modules M such that M is a semisim- 
ple f)(m, n)-module with finite-dimensional weight subspaces M^, 7 G f)(m,n)*, satis- 
fying 

(i) M decomposes over l{m,n) into a direct sum of L([(m,n),/i) for fj, G P^. 

(ii) There exist finitely many weights Ai, A2, . . . , Afc G P"*" (depending on M) such 
that if 7 is a weight in M, then 7 G Aj — "^aeuim n) for some i. 

Recall the central element K in the Lie superalgebra 0(m, n). Let OaiiT^^n) be the full 
subcategory of 0(m, n) consisting of the objects M G 0(m, n) such that Kv = av for all 
V G M. We certainly have (D{m,n) = 0^^^ Oa("i,n). The parabolic Verma modules 
^(m.n)(/") ^iid irreducible modules L^^^,^-^{^) for /i G P^ PI f)(m,n)* lie in Oa(m,n), by 
Proposition 6.2 below. The categories 0a(?7i, are abelian. Analogously we have four 
variants of the above categories with similar properties for Lie superalgebras g(m,n), 
0(m, n), g^(m, n), and 0*(m,n) in self-explanatory notations. For V G Oa(m, n), we 
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define a natural Z2-gradation y = Vg Vj similar to (4.1). This allows us to define a 
subcategory 0^{m,n) of (D^{m,n) as before and analogously we have three variants of 
the above categories for Lie superalgebras g(m, n), 0*(m,n), and Q^{m,n). 

Let M be an []-, f)-, f)-, [)^- or [^-module such that M = 0^M^, where 7 runs over 
7 G Z]jgz+ '^^-^ + ^i<j<k + SjgN + *CAo. For m, n G Z+ U {00}, we consider 
the truncated vector space 

tr(^,,)(M) = 0M„ 

V 

where the sum is over v G X]_m<j<o 

Lemma 6.1. Lei m,n £ Z+ U {00} and /i G P^'". T/ien, tr(m,ri) (-^(^i /^)) t(m,n)- 
module, and 



(6-1) tr(^,„)(L([,^)) 



L{l{m,7i),fi), if {fi,Ejj) = 0,Vj < -m,Vj > n + 1, 
0, otherwise. 



Parallel results hold for the truncation of L(l, fi), L(l, fj.), L^{1^ , fi^), L ([ 

As a consequence of the lemma above, we obtain exact functors tr(m „) : 0^ 
O0(m,n), tr(^,„) : Oa ^ Oa(m,n), tr(„,„) : 0° ^ 0°(m,n), tr(^,„) : 0^° ^ Oa°("^,?^) 

— oO — oO 

and tX(^rn,n) :0a ^ Oa ("i>")> by sending M to tr(m^„)(M). 

The following lemma can be proved by the same arguments as in [CLW, Lemma 3.2] 
and [Don, Proposition 1.5]. 

Proposition 6.2. Let m,n £ Z+ U {00}, fi G and X = L,A, U . 

(i) tr(^„)(X(/I)) = p(-'")(^)' ^/(/^>4) = 0,V,<-,n&,>n + l, 

I 0, otherwise. 

(ii) tt(™n)(X(^)) = |''^™'")^''^' ^/(/^'^..)=0'^J-^— ^^-^-+1' 

I 0, otherwise. 

(iii) tr(^n)(X(7l)) = p(™''^)^^)' ^/(/^'%)=0>Vj<-m&j>n + l, 
I 0, otherwise. 

I 0, otherwise. 

(V) tt,„„,(X«(p)) = H.»)"^'' ■(f(r,£,,)=0,Vi<-»&i>n+l, 

I 0, otherwise. 

Remark 6.3. Let A G P"*" and m,n £ Z+ U {00}. Let d denote the boundary operators 
for the complexes of the homology groups H,{u-; L{X)), H,{u-; L{X)), iL,(u_; L(A)), 
if,(u^;I(A*)), and H,{u^_;L{T)). From the formula of d (see e.g. [CL2, (4.1)]) it is 
easy to see that the truncation functors are compatible with d, i.e.. 
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It follows that truncation functors tr(m,n) send these u-homology groups to the cor- 
responding u-homology groups, and the corresponding module multiplicities of Levi 
subalgebras (or equivalently the corresponding Kazhdan-Lusztig polynomials) match 
under the truncation functors. 

6.2. Character formulas for g[(A:|2)-modules in the BGG category. Let A G 

. Then Proposition 6.2 and Theorem 4.6 together imply that, for any m,n € 
the character of the irreducible 0*(m|n)-module L^„(A ) can be computed from 
knowledge of the irreducible character of the g-module L{X). On the other hand chL(A) 
is determined by the the coefficients Ufj^x = i^x{l), where the polynomials i^x{q) are 
type A parabolic Kazhdan-Lusztig polynomials (see Section 4.4). 

Recalling the notations from Section 6.1 we note that g^(l,0) = g[(A;|2) CK (see 
Section 2.1), where g[(A;|2) denotes the Lie subalgebra of linear transformations on 
®i=i'CVi®Cv_i 0Ct;i. Recall that P+ = [JaeC^a- Now choose Fq = so that 

li Q is simply the Cartan subalgebra of 0*(1,O). Now for a fixed a G C, m, n € N and 
A° G Z we have 

m—l n 
i=0 j 1=1 

This corresponds to the dominant tuple (a, A^, . . . , A^; A~, A^), with A~ = (l'"), and 
A"*" = (1"). Thus, we have by Lemma 3.2 

A* = aAo — me_ 1 + A^eT + ne i . 

2 — ' J 2 

j 

Now let II = pe_i + Y^^i-i X^(^7 + Q^i be any integral weight of QUk\2). Suppose we 

2 '—^J — ^ J J 2 

want to compute the character of the irreducible module with highest weight /i with 
respect to the Borel associated to the following fundamental system: 

(6-2) ^ — o — O O — O — ® 

First, by tensoring with an integral multiple of the determinant representation, if nec- 
essary, we can assume that q = Q and p Z. Now choose a = —p. Then the weight 
A corresponding to the dominant tuple A = (— p. A?, • • • , A^, 0, 0) restricts precisely to 
the weight ^ on g[(A;|2). It follows that the irreducible character of any integral high- 
est weight with respect to the Borel associated to the fundamental system (6.2) are 
determined by the usual Kazhdan-Lusztig polynomials of type A Lie algebras. 

Now consider the standard Borel subalgebra of 0[(fc|2) corresponding to the following 
fundamental system: 



(6-3) o — o — o o — o — o 
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Note that the Dynkin diagram in (6.2) is related to the standard Dynkin diagram (6.3) 
by a sequence of odd reflections with respect to the following odd roots: 

(6.4) e_i 1 -e2>---e-i -ep 

Let us use A'(7) and L'{^) to denote the 0[(A;|2)-Verma and irreducible modules of 
highest weight 7 with respect to the Borel associated to (6.3). Now suppose that we 
have for A G 

diL^iX) = y^a^AchA^(//), 
where A*(/x) is the Verma module with respect to the Borel in (6.2). Let [A*]' be the 

— O 

highest weight obtained from A by applying the sequence of odd reflections in (6.4) 
following the prescription of Lemma 3.4. Furthermore, we observe that 

k 

chA*(/i) = chA'(/x - /ce^ 1 + ^ e-). 

i=l 

Thus, we conclude that 



chL'([r]') = «MAchA'(^ + ^ _ fee 



1 

2' 

i=l 



Therefore, the Kazhdan-Lusztig polynomials of type A also solve the character problem 
for irreducible highest weight modules with highest weights with respect to the standard 
Borel of s[(A:|2). 

6.3. A variant of Brundan's conjecture. For notations on Fock spaces below, 
we will refer to [CWZ, CW] (which differs somewhat from [Brl]). Let V with basis 
{vi}i£Z denote the natural C/q(g[oo)-module and let V* denote its dual module with ba- 
sis {wi}i(zz. The "Fock space" A"^Y* (g)Y®^ (g) A"-V* admits a standard basis (using Uj's 
and Wi's). One can define a bar involution on A^V* (E>Y^^ (8 A"V* which is compatible 
with the bar involution on Uq{Ql^). This gives rise to the canonical basis and dual 
canonical basis on (a completion of) A™V* (g) V®*^ (g) A"V* (cf. [Lu, Brl]). 

We denote by Orn\k\n the parabolic BGG category of 0l(A;|?n + ri)-modules of integral 
weights, which are semisimple with respect to the Levi subalgebra Ql{m) © f)fc © sK"-) 
(here f)^ denotes the Cartan in g[(A;)), with respect to the Borel associated to the 
fundamental system below: 



O O — — o — O C^O — — o o 



We shall prove a variant of Brundan's conjecture (see [Brl, Conjecture 4.32]) which 
can be informally formulated as follows. Note that the Borel subalgebra used here is 
not a standard one in contrast to Brundan's original setting. 
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Theorem 6.4. The category Om\k\n categorifies the Ug{Ql^) -module A^V* (g) V^^ (g) 
A"V*, where the parabolic Verma, tilting and simple Q[{k\m + n)-modules correspond 
to the standard, canonical, and dual canonical basis (at q = 1), respectively. 

The essence of Brundan's conjecture is that the entries of the transition matrix 
between the (dual) canonical basis and the standard basis on A™'V*(8'V®'^(8)A"V* should 
be interpreted as the Kazhdan-Lusztig polynomials for the category Orn\k\n- Indeed our 
approach is powerful enough to establish that these transition matrix entries coincide 
with the Poincare polynomials for the corresponding u-homology groups defined in 
Section 4.4. A precise formulation of Theorem 6.4 and its variants with self-contained 
proofs would take many pages as it would require us to repeat in our setting much 
of the notations and constructions in [Brl, CW] among other things. Let us instead 
sketch a proof of Theorem 6.4 below. 

The space of semi-infinite g-wedges decomposes according to "sectors" labeled by Z 
([KMS]). For a € Z, let a°°~^°'Y be the space of semi-infinite g- wedges of sector a, which 
is isomorphic to the highest weight Uq{Qi^)-module L{Aa) of highest weight being the 
ath fundamental weight. Similarly the space A°°~"V* of semi-infinite wedges of "sector 
—a" is also isomorphic to the Uq{Ql^)-module L{Aa)- The canonical isomorphism of 
[7g(g[3o)-modules a'^+'^V = A°°~"V* commutes with the bar involution. (This extends 
the observation made in [CWZ] for a = 0.) This induces an isomorphism of Uq{gl^)- 
modules 

which matches the standard, canonical, and dual canonical bases, respectively. Based 
on this together with Theorem 4.11 as well as a Fock space reformulation (cf. e.g. 
[CW, Theorem 4.14] for a special case; the general case is similar) of the Kazhdan- 
Lusztig conjecture for parabolic BGG categories in type A [BB, BK, KL], we establish 
a version of Theorem 6.4 for m = n = oo. Theorem 6.4 for finite m and n follows from 
this version for m = n = oo and the compatibility of the (dual) canonical basis for 
varying m,n (compare [CWZ, Corollary 2.10], [CW, Corollary 2.6]). 

Remark 6.5. Note that Theorem 6.4 for m = n = 1 solves the irreducible character 
problem of the full BGG category of 3[(/c|2)-modules, which can also be viewed as a 
reformulation of the result in Section 6.2. On the other hand, it is easy to give a formula 
for the irreducible characters in the category Orn\k\n ^oi general m and n, in the spirit 
of Section 6.2, if one is willing to introduce messier notations. 

7. Some more variations 

The formulation and construction in this paper have variations which unfortunately 
involve more complicated notations. In this section, we will explain one such variation 
and its implication on u-homology computation. 

For fixed p,q £ Z+, let F = {r e \ - p<r<Ooi^<r<q}. Set J = I U F, 

J = I U F, r = r U F and F = F U F. The subalgebra of g generated by Ers with 
r, s G J (respectively J, J*, J ) is denoted by S (respectively S, and S )• Similar 
results in Section 3 and Section 4 are still valid if g (respectively g, g^ and g*) are 
replaced by S (respectively S, and S )• It is worth pointing out that the sets F+, 
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, P^'^ and P^ of all dominant weights are determined by the choice of the orderings 
preserving the orderings of positive integers, positive half integers, non-positive integers 
and negative half integers and satisfying i < 6 < j for i € — 6 G IK and j G ^N. 
We do not carry out any details here. 

Let us illustrate by an example. Define orderings of J = I U F, JJ = I U F, = I* U -F 
and JJ =1 U F respectively by 

1 3 1- 

•••^-2^-1^0^-p+-^---^---<--^l^---^fc 

1 3 1 
-<-^-^...^g---<1^2^..., 

1 3 1 _ _ 

•••^-2^-1^0^-p+-^---^---<--^l^---^A; 

1 3 

^ 1 ^2^ ••• - ^ - ^ ••■ , 

3 1 - - 

< --^ --^ -p+l ^ 2^-1^0^1^---^A: 

13 1 -, o 

^ - ^ - ^ ■ ■ ■ ^ q <1^2^-- - , 

2 2 ^2 

3 1 - - 

■■•-<--^--^-p+l^ 2^-l-<0-<l-<----<A; 

1 3 

-<1^2^---^g^-^-^---. 

The corresponding fundamental systems are indicated in the following Dynkin dia- 
grams: 



g: © — ^ — © — — ® — — ® — — ® 

2 ^ 2 2 ^2 

g: © — — © — — ® — O — © — — ® 
g^: © — (g^ — © — o — © — — © — — © 

r: © © O © O © — ® 

Let a, Ai, . . . , Afc S C, A~ and A"*" be two partitions. Associated to the tuple A 
(a, Ai, . . . , Afc; A~, A'^) satisfying the dominant condition (2.3), set 

k q 

A+(A) := Ke, + Y.^\^)'^'^.^, + E^^^ " 
i=i i=i jeN 

A+(A) := ^ A,e, + ^ A+e, + 5;((A+);. - q)e^_., 

i=l j=l j'eN 
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P 

j=i jeN 
p 

j=i jm 
Associated to such tuple, we define the weights 

Xf := A~(A) + A+(A), := A-(A) + A+(A), 

A^ := A"(A) + A+(A), A^ := A"(A)+A+(A). 

The sets P^, , and of all dominant weights are the sets consisting of the 
weights of the form Xp, Xp, A^, A^, respectively. The main results on super duality in 
Sections 3, 4 and 5 afford straightforward counterparts in this new setting. 

Remark 7.1. The u-(co) homology formulas in the sense of Kostant and Enright [E] for 
unitarizable modules of general linear Lie superalgebras have been computed in [LZ] 
(cf. [HLT, Theorem 5.1, Theorem 4.4]), and they can be easily recovered via the super 
duality of this paper by an appropriate choice of A and of the orderings defined in the 
example above. Let us set = p = and choose A satisfying A^ + A^,^ < a with a G Z+. 
Then we have Enright type u-(co)homology formulas for unitarizable modules L(S , Xp) 
(cf. [HLT, Theorem 4.4]). Using Theorem 4.7, its analogue for the irreducible modules 

— O — O 

P(9^, Xp) together with Enright's (co)homology formulas for L(S , A^), we recover [LZ, 
Theorem 6.1]. 
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